Operant conditioning
نویسندگان
چکیده
Operant behavior is behavior "controlled" by its consequences. In practice, operant conditioning is the study of reversible behavior maintained by reinforcement schedules. We review empirical studies and theoretical approaches to two large classes of operant behavior: interval timing and choice. We discuss cognitive versus behavioral approaches to timing, the "gap" experiment and its implications, proportional timing and Weber's law, temporal dynamics and linear waiting, and the problem of simple chain-interval schedules. We review the long history of research on operant choice: the matching law, its extensions and problems, concurrent chain schedules, and self-control. We point out how linear waiting may be involved in timing, choice, and reinforcement schedules generally. There are prospects for a unified approach to all these areas.
منابع مشابه
The operant and the classical in conditioned orientation of Drosophila melanogaster at the flight simulator.
Ever since learning and memory have been studied experimentally, the relationship between operant and classical conditioning has been controversial. Operant conditioning is any form of conditioning that essentially depends on the animal's behavior. It relies on operant behavior. A motor output is called operant if it controls a sensory variable. The Drosophila flight simulator, in which the rel...
متن کاملMolecular Mechanisms Underlying a Cellular Analog of Operant Reward Learning
Operant conditioning is a ubiquitous but mechanistically poorly understood form of associative learning in which an animal learns the consequences of its behavior. Using a single-cell analog of operant conditioning in neuron B51 of Aplysia, we examined second-messenger pathways engaged by activity and reward and how they may provide a biochemical association underlying operant learning. Conditi...
متن کاملNeural Operant Conditioning as a Core Mechanism of Brain-Machine Interface Control
The process of changing the neuronal activity of the brain to acquire rewards in a broad sense is essential for utilizing brain-machine interfaces (BMIs), which is essentially operant conditioning of neuronal activity. Currently, this is also known as neural biofeedback, and it is often referred to as neurofeedback when human brain activity is targeted. In this review, we first illustrate biofe...
متن کاملOperant reward learning in Aplysia: neuronal correlates and mechanisms.
Operant conditioning is a form of associative learning through which an animal learns about the consequences of its behavior. Here, we report an appetitive operant conditioning procedure in Aplysia that induces long-term memory. Biophysical changes that accompanied the memory were found in an identified neuron (cell B51) that is considered critical for the expression of behavior that was reward...
متن کاملOperant conditioning of head-waving in Aplysia. I. Identified muscles involved in the operant response.
A basic goal in the neurosciences is to understand the cellular mechanisms underlying associative learning. The 2 major forms of associative learning are classical conditioning and operant conditioning. In recent years considerable progress has been made towards a cellular analysis of classical conditioning in a number of different preparations. In contrast, the cellular mechanisms underlying o...
متن کاملExtending in vitro conditioning in Aplysia to analyze operant and classical processes in the same preparation.
Operant and classical conditioning are major processes shaping behavioral responses in all animals. Although the understanding of the mechanisms of classical conditioning has expanded significantly, the understanding of the mechanisms of operant conditioning is more limited. Recent developments in Aplysia are helping to narrow the gap in the level of understanding between operant and classical ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Annual review of psychology
دوره 54 شماره
صفحات -
تاریخ انتشار 2003